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Abstract 

In some particular cases we give criteria for morphic sequences to be almost periodic ^uni- 
formly recurrent). Namely, we deal with fixed points of non-erasing morphisms and with auto- 
matic sequences. In both cases a polynomial-time algorithm solving the problem is found. A 
result more or less supporting the conjecture of decidability of the general problem is given. 

1 Introduction 

Different problems of decidability in combinatorics on words are always of great interest and dif- 
ficulty. Here we deal with two main types of symbolic infinite sequences — morphic and almost 
periodic — and try to understand connections between them. Namely, we are trying to find an 
algorithmic criterion which given a morphic sequence decides whether it is almost periodic. 

Though the main problem still remains open, we propose polynomial-time algorithms solving 
the problem in two important particular cases: for pure morphic sequences generated by non-erasing 
morphisms (Section [3|) and for automatic sequences (Section 0]). In Section [5] we say a few words 
about connections with monadic logics. In particular, in a curious result of Corollary we give a 
reason why the main problem may be decidable. 

Some attempts to solve the problem were already done. In [3] A. Cobham gives a criterion for 
automatic sequence to be almost periodic. But even if his criterion gives some effective procedure 
solving the problem (which is not clear from his result, and he does not care about it at all), this 
procedure could not be fast. We construct a polynomial-time algorithm solving the problem. In [5] 
A. Maes deals with pure morphic sequences and finds a criterion for them to belong to a slightly 
different class of generalized almost periodic sequences (but he calls them almost periodic — see 
[9 J for different definitions). And again, his algorithm does not seem to be polynomial-time. 

All the results of this paper can be found in |10j . 



2 Preliminaries 

Denote the set of natural numbers {0, 1,2,...} by N and the binary alphabet {0, 1} by B. Let A 
be a finite alphabet. We deal with sequences over this alphabet, i. e., mappings x: N — ► A, and 
denote the set of these sequences by ^4 N . 
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Denote by A* the set of all finite words over A including the empty word A. If i < j are natural, 
denote by the segment of N with ends in i and j, i. e., the set {i, i + 1, i + 2, . . . ,j}. Also 
denote by x[i,j] a subword x(i)x(i + 1) . . . x(j) of a sequence x. A segment [i, j] is an occurrence 
of a word u E A* in a sequence x if x[i, j] = u. We say that u ^ A is a factor of x if « occurs in x. 
A word of the form x[0, i] for some i is called prefix of x, and respectively a sequence of the form 
x{i)x{i + l)x(i + 2) . . . for some i is called suffix of x and is denoted by x[i, oo). Denote by \u\ the 
length of a word u. The occurrence u = x[i, j] in x is A;-aligned if k\i. 

A sequence x is periodic if for some T we have x(i) = x(i + T) for each i G N. This T is called 
a period of x. We denote by V the class of all periodic sequences. Let us consider an extension of 
this class. 

A sequence x is called almost periodi^ if for every factor u of x there exists a number I such 
that every factor of x of length / contains at least one occurrence of u (and therefore u occurs in x 
infinitely many times). Obviously, to show almost periodicity of a sequence it is sufficient to check 
the mentioned condition only for all prefixes but not for all factors (and even for some increasing 
sequence of prefixes only). Denote by AV the class of all almost periodic sequences. 

Let A, B be finite alphabets. A mapping </>: A* — > B* is called a morphism if <f>(uv) = 4>(u)4>(v) 
for all u, v E A*. A morphism is obviously determined by its values on single-letter words. A 
morphism is non-erasing if |0(o)| 1 for each a E A. A morphism is fc-uniform if 1 0(a) | = k for 
each a E A. A 1-uniform morphism is called a coding. For x E A N denote 

<t>{x) = 0(x(O))0(x(l))0(x(2)) . . . 

Further we consider only morphisms of the form A* — > A* (but codings are of the form A — > B, 
which in fact does not matter, they can be also of the form A — > A without loss of generality). Let 
0(s) = su for some s E A, u E A* . Then for all natural m < n the word (p n (s) begins with the word 
m (s), so 4>°°(s) = lim n ^ oo n (s) = suc/)(u)(j) 2 (u)(j) 3 (u) . . . is well-defined. If Vn 4> n (u) / A, then 
(j)°°{s) is infinite. In this case we say that <f> is prolongable on s. Sequences of the form h(<p°°(s)) 
for a coding h: A — > B are called morphic, of the form (j)°°(a) are called pure morphic. 

Notice that there exist almost periodic sequences that are not morphic (in fact, the set of almost 
periodic sequences has cardinality continuum, while the set of morphic sequences is obviously 
countable), as well as there exist morphic sequences that are not almost periodic (you will find 
examples later). Our goal is to determine whether a morphic sequence is almost periodic or not 
given its constructive definition. 

First of all, observe the following 

Lemma 1. A sequence 4>°°(s) is almost periodic iff s occurs in this sequence infinitely many times 
with bounded distances. 

Proof. In one direction the statement is obviously true by definition. 

Suppose now that s occurs in </>°°(s) infinitely many times with bounded distances. Then for 
every m the word (p m (s) also occurs in 4>°°(s) infinitely many times with bounded distances. But 
every word u occurring in 0°°(s) occurs in some prefix <f) m (s) and thus occurs infinitely many times 
with bounded distances. □ 

For a morphism <j>: {1, . . . , n} — > {1, . . . , n} we can define a corresponding matrix M((j>), such 
that M((f>)ij is a number of occurrences of symbol i into <fi(j). One can easily check that for each I 
we have M((j)) 1 = M(<j> 1 ). 

Morphism (j) is called primitive if for some I all the numbers in M(cj) 1 ) are positive. 

x It was called strongly or strictly almost periodic in [3 Ej. 
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Let us construct an oriented graph G corresponding to a morphism. Let its set of vertices be 
A. In G edges go from b G A to all the symbols occurring in 4>(b). 

For 0°°(s) it can easily be found using the graph corresponding to which symbols from A 
really occur in this sequence. Indeed, these symbols form the set of all vertices that can be reached 
from s. So without loss of generality from now on we assume that all the symbols from A occur in 

A morphism is primitive if and only if its corresponding graph is strongly connected, i. e., there 
exists an oriented path between every two vertices. This reformulation of the primitiveness notion 
seems to be more appropriate for computational needs. 

By Lemma Q] (and the observation that codings preserve almost periodicity) morphic sequences 
obtained by primitive morphisms are always almost periodic. Moreover, in the case of increasing 
morphisms (such that \<fi(b)\ ^ 2 for each b) this sufficient condition is also necessary (and this 
is a polynomial-time algorithmic criterion). However when we generalize this case even on non- 
erasing morphisms, it is not enough to consider only the corresponding graph or even the matrix 
of morphism (which has more information), as it can be seen from the following example. 

Let 0i be as follows: 01, 1 -> 120, 2^2, and 4> 2 be as follows: -> 01, 1 -> 210, 2^2. 
Then these two morphisms have identical matrices of morphism, but 0i°(O) is almost periodic, while 
02° (0) is not. Indeed, in (jyf (0) there are arbitrary long segments like 222. . . 22, so 02° (0) ^ AV. 
There is no such problem in 0J°(O). Since occurs in both 0i(O) and </>i(l), and 22 does not occur 
in 0J°(O), it follows that occurs in </>f°(0) with bounded distances. Thus 0*^(0) for every m ^ 
occurs in 0J°(O) with bounded distances, so 0f°(O) G AV. See Theorem [1] for a general criterion of 
almost periodicity in the case of fixed points of non-erasing morphisms. 

To introduce a bit the notion of almost periodicity, let us formulate an interesting result on this 
topic. It seems to be first proved in [3], but also follows from the results of [D]. For x G A N , y G 
define x x y G (A x B) N such that (x x y)(i) = (x(i),y(i)). 

Proposition 1. If x is almost periodic and y is periodic, then x x y is almost periodic. 

3 Pure Morphic Sequences Generated by Non-erasing Morphisms 

Here we consider the case of morphic sequence of the form 0°°(s) for non-erasing cp. We present an 
algorithm that determines whether a morphic sequence 0°°(s) is almost periodic given an alphabet 
A, a morphism <f> and a symbol s G A. 

Suppose we have A, (ft and s G A, such that \A\ = n, maxjgyi \<f>(b)\ = k, s begins 4>(s). 
Remember that we suppose that all the symbols from A appear in </>°°(s). 

Divide A into two parts. Let / be the set of all symbols b G A such that \4> m (b)\ — > oo as 
m — > oo. Denote F = A\I, it is the set of all symbols b such that \(j) m (b)\ is bounded. Also define 
E C F to be the set of all symbols b such that \(f>(b)\ = 1. 

We can find a decomposition A = I U F in poly(n, fe)-time as follows. 

Find E. Then find all the cycles in G with all the vertices lying in E. Join all the vertices of all 
these cycles in a set D. This set is stabilizing: F is the set of all vertices in G such that all infinite 
paths starting from them stabilize in D. Polynomiality can be checked easily. 

Construct "a graph of left tails" L with marked edges. Its set of vertices is /. From each vertex 
b exactly one edge goes off. To construct this edge, find a representation 4>(b) = uv, where cEl, 
u is the maximal prefix of <p(b) containing only symbols from F. It follows from the definitions 
of / and F that u does not coincide with <f>(b), that is why this representation is correct. Then 
construct in L an edge from b to c and write u on it. 
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Analogously we construct "a graph of right tails" R. (In this case we consider representations 
0(6) = vu where u € F*, c € I.) 

Now we formulate a general criterion. 

Theorem 1. A sequence 0°°(s) is almost periodic iff 

1) G restricted to I is strongly connected; 

2) in graphs L and R on each edge of each cycle an empty word A is written. 

It seems that full and detailed proof of this theorem can only confuse a reader, rather than a 
proof sketch. 

Proof sketch. By Lemma [T] for almost periodicity it is necessary and sufficient to check whether 
symbol s occurs infinitely many times with bounded distances. 

For every symbol b £ I the symbol s should occur in some (j) l (b), that is what the 1st part of 
the criterion says. 

Furthermore, in the sequence <j)°°(s) all the segments of consecutive symbols from F should be 
bounded. Indeed, every such segment consists only of symbols from F, but s (f: F. That is what 
the 2nd part of the criterion means, let us explain why. 

Consider some v = buc occurring somewhere in 0°°(a), where b,c £ I, u £ F* . Every element 
of sequence of words v, 4>(v), (f) 2 (v), 4> 3 (v), . . . occurs in 4>°°(s). Somewhere in the middle of 4> l (v) = 
4> l {b)4> 1 \u)4> 1 '(c) a word (fi{u) occurs. As I increases, some words from F* might stick to (u) from 
left or right for these words can come from (j) l (b) or (c). These words exactly correspond to those 
written on edges of L or R. The 2nd part of the criterion exactly says that this situation can 
happen only finitely many times, until we get to some cycle in L or R. □ 

Let us consider examples with 0i and 02 from the end of Section [2j In both cases I = {0, 1}, 
F = {2}. On every edge of R in both cases A is written. Almost the same is true for L: the only 
difference is about the edge going from 1 to 1. In the case of <f>\ an empty word is written on this 
edge, while in the case of 4>2 a word 2 is written. That is why $>f°(0) is almost periodic, while <^2°(0) 
is not. 

Corollary 1. If for all b £ A we have \(j>(b)\ #J 2, then (f>°°(s) is almost periodic iff (j) is primitive. 

Proof. Follows from Theorem [TJ In that case A = I, and on all the edges of L and R the empty 
word is written. □ 

Corollary 2. There exists a poly(n, k)-algorithm that says whether 4>°°(s) is almost periodic. 

Proof. Conditions from Theorem [T] can be checked in polynomial time. □ 

It also seems useful to formulate an explicit version of the criterion for the binary case. We do 
it without any additional assumptions, opposite to the previous. 

Corollary 3. For non-erasing <f>: IB — > B that is prolongable on a sequence (j>°°(0) is almost 
periodic iff one of the following conditions holds: 

1) 0(0) contains only 0s; 

2) 0(1) contains 0; 

3) 0(1)= A; 

4) 0(1) = 1 and 0(0) = OnO for some word u. 
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4 Uniform Morphisms 



Now we deal with morphic sequences obtained by uniform morphisms. Again we present a polynomial- 
time algorithm for solving the problem in this situation. 

Suppose we have an alphabet A, a morphism <p: A* — > A* , a coding h: A —* B, and s € A, such 
that \A\ = n, \B\ ^ n, V6 £ A \4>(b)\ = k, s begins 4>(s). We are interested in whether h(4>°°(s)) is 
almost periodic. Sequences of the form h(4>°°(s)) with <fi being fc-uniform are also called ^-automatic 
(see [I]). 

4.1 Equivalence Relations and Uniform Morphisms 

For each I G N define an equivalence relation on A: b ~; c iff h((f> l (b)) = h((f> l (b)). We can easily 
continue this relation on A*: u ~; v iff h(4> l (u)) = h((j) l (v)). In fact, this means |u| = [v| and 
u(i) ~; for all i, 1 ^ i ^ \u\. 

Let -B m be the Bell number, i. e., the number of all possible equivalence relations on a finite 
set with exactly m elements, see |13j . As it follows from this article, we can estimate B m in the 
following way. 

Lemma 2. 2 m < B m ^ 2 Cmlo ^ m for some constant C. 

Thus the number of all possible relations ~; is not greater than B n = 2°( nlo s n ). Moreover, the 
following lemma gives a simple description for the behavior of these relations as I tends to infinity. 

Lemma 3. i/~ r equals ~ s , then ~- r +p equals ~ s + p for all p. 

Proof. Indeed, suppose ~ r equals ~ s . Then b ~ r +i c iff 4>{b) ~ r 4>(c) iff 4>{b) ~ s 4>{c) iff b ~ s +i c. 
So if ~ r equals then ~ r +i equals ~ s +i, which implies the lemma statement. □ 

This lemma means that the sequence (~z);gN turns out to be ultimately periodic with a period 
and a preperiod both not greater than B n . Thus we obtain the following 

Lemma 4. For some p,q ^ B n we have for all i and all t > p that ~t equals ^t+iq- 

4.2 Criterion 

Now we are trying to get a criterion which we could check in polynomial time. Notice that the 
situation is much more difficult than in the pure case because of a coding allowed. In particular, 
the analogue of Lemma [T] for non-pure case does not hold. 

We will move step by step to the appropriate version of the criterion reformulating it several 
times. 

This proposition is quite obvious and follows directly from the definition of almost periodicity 
since all h(<f) m (a)) are the prefixes of h(<j)°°(a)). 

Proposition 2. A sequence h((p ca (s)) is almost periodic iff for all m the word h(4> m (s)) occurs in 
h((p 00 (s)) infinitely often with bounded distances. 

And now a bit more complicated version. 

Proposition 3. A sequence ^(^^(s)) is almost periodic iff for all m the symbols that are ~ m - 
equivalent to s occur in ^°°(s) infinitely often with bounded distances. 
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Proof. <=. If the distance between two consecutive occurrences in </>°°(s) of symbols that are ~ m - 
equivalent to s is not greater than t, then the distance between two consecutive occurrences of 
h(4> m (s)) in h(4>°°(s)) is not greater than tk m . 

=>. Suppose /i(0°°(s)) is almost periodic. Let y m = 012 . . . (k m - 2)(k m - 1)01 . . . {k m - 1)0 . . . 
be a periodic sequence with a period k m . Then by Proposition [1] a sequence h(4>°°(s)) x y m is almost 
periodic, which means that the distances between consecutive /c m -aligned occurrences of h(4> m (s)) 
in h((j)°°(s)) are bounded. It only remains to notice that if h(cj)°° (s))[ik m , (i + l)k m — 1] = h((p m (s)), 
then <j>°°{s)(i) ~ m s. □ 

Let Y m be the following statement: symbols that are ~ m -equivalent to s occur in <f)°°(s) infinitely 
often with bounded distances. 

Suppose for some T that is true. This implies that h(cj) T (s)) occurs in h((j) 00 (s)) with bounded 
distances. Therefore for all m ^ T a word /i((/> m (s)) occurs in h((j) co (s)) with bounded distances 
since h((j) m (s)) is a prefix of h((f> T (s)). Thus we do not need to check the statements Y m for all m, 
but only for all m ^ T for some T. 

Furthermore, it follows from Lemma HI that we are sufficient to check the only one such state- 
ment as in the following 

Proposition 4. For all r B n : a sequence h(4>°°(s)) is almost periodic iff the symbols that are 
~ r - equivalent to s occur in </>°°(s) infinitely often with bounded distances. 

And now the final version of our criterion. 

Proposition 5. For all r ^ B n : a sequence h((f>°°(s)) is almost periodic iff for some m the symbols 
that are ~ r - equivalent to s occur in <p m (b) for all b € A. 

Indeed, if the symbols of some set occur with bounded distances, then they occur on each 
fc m -aligned segment for some sufficiently large m. 



4.3 Polynomiality 

Now we explain how to check a condition from Proposition [5] in polynomial time. We need to 
show two things: first, how to choose some r ^ B n and to find in polynomial time the set of all 
symbols that are ~ r -equivalent to s (and this is a complicated thing keeping in mind that B n is 
exponential), and second, how to check whether for some m the symbols from this set for all b G A 
occur in (p m (b). 

Let us start from the second. Suppose we have found the set H of all the symbols that are 
~ r -equivalent to s. For m € N let us denote by Pm the set of all the symbols that occur in 
(j) m (b). Our aim is to check whether exists m such that for all b we have Pjn ] r\H ^ 0. First of 
all, notice that if V6 P^ (~)H ^ 0, then V6 p/ b) n H / for alU ^ m. Second, notice that the 
sequence of tuples of sets ((Pm^)&es)m=o ^ s ultimately periodic. Indeed, the sequence 

o 1S 

obviously ultimately periodic with both period and preperiod not greater than 2 n (recall that n is 
the size of the alphabet S). Thus the period of ({Pm^)b£T,)m=o ^ s n °t greater than the least common 
divisor of that for (Pm)m=oi b <E A, and the preperiod is not greater than the maximal that of 
(Pm)m=o- S° the period is not greater than (2 n ) n = 2™ 2 and the preperiod is not greater than 2". 
Third, notice that there is a polynomial-time-procedure that given a graph corresponding to some 
morphism ip (see Section [2] to recall what is the graph corresponding to a morphism) outputs a 
graph corresponding to morphism ■0 2 . Thus after repeating this procedure n 2 + 1 times we obtain 
a graph by which we can easily find (Pf®2 2 „)be£> since 2™ 2+1 > 2™ 2 + 2 n . 
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Similar arguments, even described with more details, are used in deciding our next problem. 
Here we present a polynomial-time algorithm that finds the set of all symbols that are ~ r -equivalent 
to s for some r B n . 

We recursively construct a series of graphs Tj. Let its common set of vertices be the set of all 
unordered pairs (6, c) such that 6, c G A and b ^ c. Thus the number of vertices is n< - n ~ 1 ^ , The set 
of all vertices connected with (6, c) in the graph Tj we denote by Vi(b, c). 

Define a graph T . Let f (M be the set {{cf>{b){j) , <j){c){j)) \ j = I, . . . , k, </>(b)(j) + </>(c)(j)}. 
In other words, b c if and only if x ~z y for all (x, y) G Vb(6, c). 

Thus 6 ~2 c if and only if for all (x, y) G Vo(b, c) for all (z, t) G Vo(x, y) we have z ~o For the 
graph Ti let c) be the set of all (x, y) such that there is a path of length 2 from (6, c) to (x, y) 
in To. The graph T\ has the following property: b ~2 c if and only if x ~o V f° r a h (^j y) £ c )- 
And even more generally: 6 ~z+2 c if and only if x ~; y for all (x, y) G Vi(6, c). 

Now we can repeat operation made with To to obtain T\. Namely, in T<i let ^(6, c) be the set of 
all (x, y) such that there is a path of length 2 from (6, c) to (x, y) in Ti. Then we obtain: b ~;+4 c 
if and only if x ~; y for all (x, y) G c). 

It follows from Lemma [2] that log 2 .B n ^ Cnlogn. Thus after we repeat our procedure r = 
[Cn log n] times, we will obtain the graph T\ such that b ~2 r c if and only if x ~o 2/ f° r & h 
(x, y) G V2(fe, c). Recall that x ~o 2/ means /i(x) = h(y), so now we can easily compute the set of 
symbols that are ~2 r -equivalent to s. 

5 Monadic Theories 

Combinatorics on words is closely connected with the theory of second order monadic logics. Here 
we just want to show some examples of these connections. More details can be found, e. g., 
in [ID [LJ. 

We consider monadic logics on N with the relation "<", that is, first-order logics where also 
unary finite-value function variables and quantifiers over them are allowed. We also suppose that 
we know some fixed finite- value function x: N —> S and can use it in our formulas. Such a theory 
is denoted by MT(N, <,x) and is called monadic theory of x. 

The main question here can be the question of decidability, that is, does there exist an algorithm 
that given a sentence in a theory says whether this sentence is true of false. 

The criterion of decidability for monadic theories of almost periodic sequences can be formulated 
in terms of some their very natural characteristic, namely, almost periodicity regulator. An almost 
periodicity regulator of an almost periodic sequence x is a function / : N — > N such that every factor 
u of x of length n occurs in each factor of x of length f(n). So an almost periodicity regulator 
somehow regulates how periodic a sequence is. Notice that an almost periodicity regulator of a 
sequence is not unique: every function greater than regulator is also a regulator. 

Theorem 2 (Semenov 1983 [12]). If x is almost periodic, then MT(N, <, x) is decidable iff x and 
some its almost periodicity regulator are computable. 

The following result was obtained recently, but uses the technics already used in [HI [12] . 
Theorem 3 (Carton, Thomas 2002 [2j). If x is morphic, then MT(N, <,x) is decidable. 

A curious result can be implied from two these theorems. 
Corollary 4. If x is both morphic and almost periodic, then some its regulator is computable. 
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Proof. Indeed, if x is morphic, then by Theorem [3] the theory MT(N, <,x) is decidable. Since 
x is almost periodic, from Theorem [2] it follows that some almost periodicity regulator of x is 
computable. □ 



Notice that Corollary 0] does not imply the existence of an algorithm that given a morphic 
sequence computes some almost periodicity regulator of this sequence whenever it is almost periodic 
(but probably this algorithm can be constructed after deep analyzing the proofs of Theorems [2] and [3] 
and showing uniformity in a sense) . And it also does not imply the decidability of almost periodicity 
for morphic sequences. This decidability also does not imply Corollary HI 

By the way, Corollary H] allows us to hope that these algorithms exist. Though the formulation 
of this statement uses only combinatorics on words, the proof also involves the theory of monadic 
logics. Of course, it would be interesting to find a simple combinatorial proof of the result. 

And the last remark here is that Corollary |4] (and its probable uniform version) seems to be 
the best progress that we can obtain by this monadic approach. One could try to express in the 
monadic theory of morphic sequence (which is decidable by Theorem [3]) the property of almost 
periodicity, but it turns out to be impossible. 



6 In General Case 

We have described two polynomial-time algorithms, but without any precise bound for their working 
time. Of course, it can be done after deep analyzing of all the previous, but is probably not so 
interesting. 

It is not still known whether the problem of determining almost periodicity of arbitrary morphic 
sequence is decidable. Corollary H] somehow supports the conjecture of decidability (but even does 
not follow from this conjecture!). 

Theorem 7.5.1 from [I] allows us to represent an arbitrary morphic sequence h((p ac (s)) as 
g(V>°°(&)) where ip is non-erasing. So it is sufficient to solve our main problem for h((f)°°(s)) with 
non-erasing (p. 

It seems that the general problem is tightly connected with a particular case of h(4 >oa (a)) where 
\4>(b)\ ^ 2 for each b £ A. There is no strict reduction to this case but solving problem in this case 
can help to deal with general situation. 

The problem of finding an effective periodicity criterion in the case of arbitrary morphic se- 
quences is also of great interest, as well as criteria for variations with periodicity and almost pe- 
riodicity: ultimate periodicity, generalized almost periodicity, ultimate almost periodicity (see [9] 
for definitions). If one notion is a particular case of another, it does not mean that corresponding 
criterion for the first case is more difficult (or less difficult) than for the second. 
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